
United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 

Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria. Virginia 223I3-14S0 
www.uspto.gov 



APPLICATION NO. | 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 


10/620,505 


07/16/2003 


Jack Cassidy 


200311036-1 


8478 



7590 11/01/2007 

HEWLETT-PACKARD COMPANY 
Intellectual Property Administration 
P.O. Box 272400 
Fort Collins, CO 80527-2400 



EXAMINER 



DICKERSON, CHADS 



ART UNIT 



2625 



PAPER NUMBER 



MAIL DATE 



DELIVERY MODE 



11/01/2007 PAPER 

Please find below and/or attached an Office communication concerning this application or proceeding. 

The time period for reply, if any, is set in the attached communication. 



PTOL-90A (Rev. 04/07) 



1 



Office Action Summary 


Application No. 

10/620.505 


Applicant(s) 

CASSIDY ETAL 


Examiner 

Chad Dickerson 


Art Unit 

2625 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 

after SIX (6) MONTHS from the mailing date of this communication. . . 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) f^ONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

I) 13 Responsive to connmunication(s) filed on 8/23/2007 . 

2a)IEI This action is FINAL. 2b)n This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits Is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) S Claim(s) 1-48 is/are pending in the application. 

4a) Of the above claim(s) 1.2.7.12-14.21.22.27.32-34.41.42,44.45.47 and 48 is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) ^ Claim{s) 3-6.8-1 1.1 5-20.23-26.28-31. 35-40.43 and 46 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) ^ The specification is objected to by the Examiner. 

10)13 The drawing(s) filed on 16 July 2003 is/are: a)K accepted or b)^ objected to by the Examiner. 
Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) Is objected to. See 37 CFR 1.121(d). 

I I) n The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)n Some * 0)0 None of: 

1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) ^ Notice of References Cited (PTO-892) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) □ Infonmation Disclosure Statement(s) (PTO/SB/08) 

Paper No(s)/Mail Date . 



4) n Inten/lew Summary (PTO-413) 

Paper No(s)/Mail Date. . 

5) n Notice of Infomial Patent Application 

6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 08-06) 



Office Action Summary 



Part of Paper No./Mail Date 20071025 



Application/Control Number: 10/620.505 Page 2 

Art Unit: 2625 

DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments, see page 16, filed 8/23/2007, with respect to the drawing 
objection have been fully considered and are persuasive. The objection of figures 20 
and 21 has been withdrawn. 

2. Applicant's arguments filed 8/23/2007 have been fully considered but they are 
not persuasive. Since the Applicant did not address the objections Involving the 
specification the specification objections are maintained. 

3. Applicant's arguments, see page 16, filed 8/23/2007, with respect to claim 
objection have been fully considered and are persuasive. The claim objection of claim 
32 has been withdrawn. 

4. Applicant's arguments, see page 16. filed 8/23/2007, with respect to the 1 12 
second paragraph rejections have been fully considered and are persuasive. The 112 
second paragraph rejections of claims 2, 6. 11, 22, 23, 31 and 42 have been withdrawn. 

5. Applicant's arguments filed 8/23/2007 have been fully considered but they are • 
not persuasive. 

In the Amendment filed on 8/23/2007, the Applicant traversed the rejection of the 
claims. The applicant traversed the rejection asserting that the reference of Simon '375 
does not disclose the feature of the existence or identification of a set of digital images 
each having a pre-detennined print size as well as the placement of images having an 
identified largest predetermined print size in an identified packing area. The Examiner 
disagrees with this assertion. 
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Referring to the feature of the identification of a set of digital images each having 
a pre-determined print size, the Examiner believes that this feature is performed. In the 
system of Simon '375, it is understood that the digital images In the system have a pre- 
determined printing size. In the system the size of the images placed on the layout can 
be considered as the print size since the image will be the respective size when printed. 
The print size is pre-determined since this size is determined by the source that 
obtained the image or photograph. In the system that obtains these Images to place In 
a layout, the print size that has been detemilned by the source that obtained the image 
is identified and when the image is placed on a layout, it is checked, or identified to see 
if this image is the smallest or largest to be placed on the layout. Once the 
determination of the print size of the image has occurred, the normalization process 
may be perfomied to adjust the image In order to improve the placement of the Image 
on the layout. The tenri "pre-determined print size" is being broadly interpreted since 
the nature of the image being placed has a print size that relates to the size of the 
image on the layout that can be printed and the size is pre-determined since the image 
set to be a certain size was set to that certain size by the source that obtained the 
image and sent that image to a database. This explanation can be found in the 
specification in paragraphs [0046]-[0057]. These paragraphs describe different pictures 
or Images with different aspect ratios being used in the system. The different aspect 
ratios had to have been set sometime before the images arrived in the present system 
to be placed on a layout and because of this reasoning, the above claim feature Is 
performed. 
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The Examiner also believes that the feature of the placement of images having 
an identified largest predetermined print size in an identified packing area is also 
performed. In referring to an image having the largest predetermined print size, the 
statement of large means that something is comparatively larger or bigger than 
something else. In paragraph [0050], the disclosure states that an image may be larger 
than the rest of the images being used to be placed on a page layout. This image can 
be considered as the image with the largest predetermined print size. This image is 
identified when the system is trying to compare this image to other images to guide the 
process of normalization. Once this image that may be the largest in print size 
compared to all the images that are used, it can be placed on a certain part of the 
layout, considered as the identified packing area. The layout at this point can have 
images already present on the layout or not. Once this large image is placed on the 
layout, it is then normalized with the rest of the images to make sure it does not spatially 
dominate overall layout and to give the layout a better aesthetic makeup. This performs 
the feature of having the placement of images having an identified largest 
predetermined print size in an identified packing area (see figs. 1-7 and paragraphs 
[0046H0058]). 

Claim Rejections - 35 USC § 101 

6. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 
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7. Claims 23-26, 28-31 and 35-40 rejected under 35 U.S.C. 101 because the 
claimed invention is directed to non-statutory subject matter. 

Re claims 23, 26 and 31: the claims are towards a seemingly patentable computer 
readable medium. However, these claims are deemed to be non-statutory since the 
mere claiming of a computer readable medium with instructions is not a patentable 
process without a computer being used to realize the functionality of the instructions on 
the computer readable medium. It Is suggested that the applicant modify the claims to 
ensure that the claim language reflects that the computer readable medium is encoded 
with instructions that are executed by a computer. The dependent claims are also 
rejected. 

Claim Rejections - 35 USC § 102 

8. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
states. 

9. Claims 3-6, 8-11,1 5-17, 23-26, 28-31 , 35-37, 43 and 46 are rejected under 35 
U.S.C. 102(b) as being anticipated by Simon et al (US Pub No 2002/0040375). 

Re claim 3: Simon et al discloses a method of organizing digital images on a page, 
comprising: 
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Identifying a set of digital images (i.e. in figure 5, the step 120 allows the images 
used to be arranged on a page format to be selected manually or automatically; see fig. 
5; paragraphs [0049]-[0055]); 

identifying a pre-detennined print size for each of the digital images in the set 
(I.e. shown In the illustrated prior art image in figure 2 is a template with the 
identification of a pre-determined print size for each of the digital images to be used on 
the template. Since this template is used to identify pre-determined print sizes of the 
pictures to be used, this performs the above feature. Also, when the system is using 
the method of automatically placing pictures in the layout, the system chooses, or 
identifies, a certain pre-determined size on the overall layout to place the picture on the 
layout to be printed. With this pre-determined space, the images chosen have a pre- 
detennined print size and this size is taken into account when placing the images on the 
overall layout. The print size of the images is used to assist the system in arranging the 
images in a more aesthetic manner. The images in the system have a pre-determined 
print size since these images where taken by different sources (i.e. digital camera or 
scanner) and these different sources defined the print size for the images and therefore, 
the pre-detemriined print size feature is performed. The system may then normalize the 
pictures to take away the left over white space on the overall layout when these images 
are placed on the layout; see figs. 1-3; paragraphs [0046H0055]); 

defining a packing area (i.e. when the fomnat of a page is selected in step 110, 
this is analogous to defining a packing area. In this step, the height and width of the 
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page is specified in order to define where and witiiin a format tlie images are to be 
placed on the page; see fig. 5 and 6; paragraph [0049] and [0050]); 

identifying a largest of the predetermined print sizes (i.e. shown in the illustrated 
prior art image in figure 2 is a template with the identification of a pre-determined print 
size for each of the digital images to be used on the template. Since this template is 
used to identify pre-determined print sizes of the pictures to be used, this performs the 
above feature. When the system is using the method of automatically placing pictures 
in the layout, the system chooses, or Identifies, a certain pre-detemiined size on the 
overall layout to place the picture on the layout to be printed. In the system, an image 
may be Identified as being much larger or smaller than the rest of the images. The 
image that is much larger than the others is considered as the image with the largest 
pre-determined print size. This image Is identified when it Is chosen to be placed on the 
layout and the smallest dimension of the image may be normalized in order to create a 
spatial balance between itself and other images used in the system; see figs. 1-3; 
paragraphs [0046]-[0055]); 

if it will fit In the packing area, packing a digital image from the set having the 
identified largest pre-determined print size set in a first orientation in the packing area in 
a first trial pack (i.e. the amount of images placed on a page is determined automatically 
based on the layout and the amount of space that allows the images to achieve a 
spatial balance on the specified layout. If the image does not assist In creating a spatial 
balance or there is not enough room to fit an image on the page, the current image is 
not chosen automatically to be placed on the page. The system determines the size of 
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an area to place an image and judges whether that area should be packed with the 
image that will not overlap other images. This image has a certain print size that needs 
to be taken into account before placing the image in a certain place with other images. 
With this process being performed, this is an example of identifying an image with a pre- 
detennined print size to place on the layout in order for the image to not be overlapping 
other images. Once the image is placed, it can be determined that this image is the 
largest image placed on the layout compared to the rest of the images. Next, the 
normalizing process occurs to make sure that the image that is the largest is normalized 
in some manner to create a better spatial balance in the layout and the amount of white 
space on the layout is minimized. Also, this process occurs until there can not be any 
more images laid out on the trial layout and a score is calculated for the trial layout; see 
fig. 7 and 11-14; paragraphs [0049]-[0055]); and 

if it will fit in the packing area, packing the digital image from the set having the 
identified largest pre-determined print size in the second orientation in the packing area 
in a second trial pack (i.e. during the process that is illustrated in figure 7, the above 
process that occurs to the first or prior trial layout occurs to the new or the second trial 
layout. The new trial layout shows another orientation of the same images being used 
due to the specifications given by the aspect ration of the page format. Like the above 
explanation, this same system again detemiines the size of an area to place an image 
and judges whether that area should be packed with the image for another trial layout if 
the user has expressed dissatisfaction or the system compares to layouts with different 
scores. In this second layout, again the images with a pre-detemiined print size are 
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placed on the layout and these images are placed in a manner that will provide ample 
space for the image to be placed and not overlap any other images in the layout, and a 
nonnalizing process may occur to assist in Improving the visual aspect of the layout. 
This process also again occurs until there can not be any more images laid out on the 
trail layout and a score Is calculated for the trial layout; see fig. 7; paragraphs [0049]- 
[0055] and [0057]-[0063]). 

Re claim 4: Simon et al discloses the method of claim 3, 

wherein packing the digital image in the first orientation Includes, If the digital 
image from the set having the identified largest pre-determined print size will fit in the 
first orientation, packing as many digital images from the set having the identified 
largest pre-determlned print size as possible in the packing area in the first trial pack 
(i.e. the invention finds images of certain sizes that may fill the trial layout in an efficient 
manner. This may be a large or small sized image. The Images chosen to fill the trial 
layout shown in figures 8-10 are either the same size or a different size and the feature 
of packing as many digital images of a certain size as possible in a certain orientation in 
a trial pack is performed. The images in the system that are used have a pre- 
detemnlned size to be printed on the layout. The images are placed on the layout with a 
pre-determined size and these sizes can be the largest or the smallest to be placed and 
printed on the overall layout. The invention can pack large images, compared to other 
images, on a layout as long as the images do not overlap. These images can be 
packed until no other images can be placed on the layout anymore. Then, the process 
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of normalization may occur to make tlie overall layout have a better aesthetic look; see 
figs. 5-10; paragraphs [OG49H0057] and [0059]); and 

wherein packing the digital image in the second orientation includes, if the digital 
image from the set having the identified largest pre-determined print size will fit in the 
second orientation, packing as many digital images from the set having the identified 
pre-determined print size as possible in the second trial pack (i.e. when comparing 
which trial layout is the most efficient in figure 7, the same process that occunred to the 
first or prior trial layout also occurs to the new or second trial layout. The second trial 
layout is another orientation of the same Images and therefore, the above feature is also 
performed. Since the same process for the first orientation occurs for the second 
orientation, the feature of identifying a set of images to place within a pre-determined 
print space is also perfomned. Like in the first orientation, the. images in the system that 
are used have a pre-determined size to be printed on the layout. The images are 
placed on the layout with a pre-determined size and these sizes can be the largest or 
the smallest to be placed and printed on the overall layout. The invention can pack 
large images, compared to other images, on a layout as long as the images do not 
overlap. These images can be packed until no other images can be placed on the 
layout anymore. Then, the process of normalization may occur to make the overall 
layout have a better aesthetic lo; see fig. 5-10; paragraphs [0049]-[0055] and [0059]- 
[0063]). 

Re claim 5: Simon et al the method, wherein: 
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identifying a largest of the pre-determined print sizes (i.e. shown in the illustrated 
prior art image in figure 2 is a template with the identification of a pre-detemnined print 
size for each of the digital images to be used on the template. Since this template is 
used to identify pre-determined print sizes of the pictures to be used, this performs the 
above feature. When the system is using the method of automatically placing pictures 
in the layout, the system chooses, or identifies, a certain image with pre-determined 
size to be placed on the overall layout to be printed. The image can be the largest or 
the smallest image out of the images chosen. This performs the feature of identifying 
an image with the largest pre-detennlned print size to be placed in the layout and 
placing the image or images on the page. The system may then normalize the pictures 
to take away the left over white space on the overall layout; see figs. 1-3; paragraphs 
[0046]-[00551), comprises 

identifying, from a set of digital images, a largest pre-detemiined print size that 
will fit in the packing area (i.e. although identifying the largest pre-determined print size 
is not specifically disclosed, it is perfomned by the device. With normalization, the 
largest sized image is isotropically scaled so that the shortest dimension of the image is 
equivalent to the other images used in the page format. The image with a certain size, 
which is identified, is the image that will create a spatial balance in the page forniat. 
This image can be the largest or the smallest size. The image will still be normalized to 
fit the image together with the other images to have the page fonnat displayed to the 
user in a balanced manner. With the system automatically identifying the image with 
the largest pre-determined print size in group of chosen images to use, the system 
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takes this information in order to figure out a way to normalize the image so that the 
image does not dominate the entire image. This is an example of identifying the largest 
pre-determined print size of an Image, packing the image in the layout, but also 
normalizing the image so that it does not dominate the overall layout. The image 
Identified is considered to have a pre-detennined print size since the source of the 
image determined the size of the image before the image was actually used in the 
current system shown in figure 1 to organize and pack images on a layout; see figs. 5- 
10; paragraph [0050H0057]); and 

packing as many digital images of the identified largest pre-detemiined print size 
as possible comprises repeatedly packing digital images of the identified largest pre- 
determined print size in a given orientation until either another digital image of the 
identified largest pre-detemiined print size will not fit or no digital image of the identified 
largest pre-determined print size remains in the set (i.e. the invention finds images of 
certain sizes that may fill the trial layout in an efficient manner. This may be a large or 
small sized image. The images chosen to fill the trial layout shown in figures 8-10 are 
either the same size or a different size and the feature of packing as many digital 
images of a certain size as possible in a certain orientation in a trial pack is performed. 
The Images are placed on the page layout until the images will not fit on the page in 
order to create a spatial balance. Also, because of the selection criteria listed in 
paragraph [0050], certain images do not remain since the images do not meet criteria 
set by the user. The other feature of no digital image of the identified size remains in 
the set is perfomned since the identified size may be associated with a time and date 
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and If the image of the above time and date criteria does not remain, the above feature 
is performed. With the system automatically identifying the image with the largest pre- 
detemriined print size In group of chosen images to use, the system takes this 
information In order to figure out a way to normalize the image so that the image does 
not dominate the entire Image. This Is an example of Identifying the largest pre- 
determined print size of an image, packing the image in the layout, but also normalizing 
the Image so that it does not dominate the overall layout. With the images Identified, 
one, a couple, or all of the Images may be considered as the largest in print size if these 
Images are compared to the other Images used In making up the layout. The images 
Identified are considered to have a pre-detemnined print size since the source of the 
images determined the sizes of the Images before the images were actually used in the 
current system shown in figure 1 to organize and pack images on a layout; see figs. 5- 
10; paragraphs l0049]-[0055] and [0059]). 

Re claim 6: Simon et al discloses a method for generating trial packs from a set of 
digital images, each digital Image in the set having a pre-determined print size (I.e. 
shown In the illustrated prior art image in figure 2 is a template with the identification of 
a pre-detemilned print size for each of the digital Images to be used on the template. 
Since this template is used to identify pre-determined print sizes of the pictures to be 
used, this perfomis the above feature. Also, when the system is using the method of 
automatically placing pictures in the layout, the system chooses, or identifies, a certain 
pre-determlned size on the overall layout to place the picture on the layout to be printed. 
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With this pre-determined space, the images chosen have a pre-determined print size 
and this size is taken into account when placing the images on the overall layout. The 
print size of the images is used to assist the system in arranging the images in a more 
aesthetic manner. The images in the system have a pre-determined print size since 
these images where taken by different sources (i.e. digital camera or scanner) and 
these different sources defined the print size for the images and therefore, the pre- 
detennined print size feature is perfonned. The system may then normalize the pictures 
to take away the left over white space on the overall layout when these images are 
placed on the layout; see figs. 1-3; paragraphs [0046H0055]), the method comprising 

opening a trial pack as an empty page (i.e. figure 6 is an example of an empty 
trial layout. This shows a view of the page in which the pictures of figure 3 will be 
placed; see fig. 3 and 6; paragraphs [0038] and [0050]); 

continuing, if possible, each open trial pack (i.e. the selection of the images 
placed on the trial layout are automatically selected based on the width, height or 
aspect ratio of the page. With the images chosen automatically, the images are 
continually placed on the page to fit the fomiat chosen and normalizing of the images 
also takes place. The normalizing ensures that the images are distanced from one 
another in an equivalent manner to create a spatial balance between the pictures; see 
fig. 5; paragraphs [0049]-[0055]) and closing each trial pack that cannot be continued 
(i.e. once normalizing takes place, the images are placed to create a spatial balance. 
Once this is shown to the user for acceptance, the user has a choice to accept the 
layout or go through the page layout process again until an acceptable page layout is 
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obtained. The layout process is completed or closed once the user is displayed the new 
layout; see fig. 5; paragraphs [0049]-[0055]); and 

repeating the continuing and closing until no trial pack remains open (i.e. when 
performing the process of comparing accepting a page layout, the process of continuing 
to apply images to certain layouts and closing the process of adding images because 
the layouts have the appropriate amount of images on a page is repeated until a user 
decides to accept a displayed layout. At the point where the layout is displayed Is a 
point in which the trial layout is closed; see fig. 5; paragraphs [0049]-[00551). 

wherein continuing, comprises, upon determining that at least one digital 
Image from the set that has yet to be packed in the open trial pack will fit in the 
packing area (i.e. in the system, a given number of images are to be laid out on a 
certain page layout. The system ensures that this given number is met. If this given 
number is not met for the layout, the system makes the determination and then looks for 
the image to be placed on the page layout to fit the given number of images on the page 
layout. This is an example of the continuing function occurring in the system; see figs. 
5-10; paragraphs [0050]-[0064]): 

identifying a largest pre-detemiined print size of a digital 
image remaining in the set that will fit in the packing area (i.e. shown in the Illustrated 
prior art image in figure 2 is a template with the identification of a pre-detemriined print 
size for each of the digital images to be used on the template. Since this template is 
used to identify pre-determined print sizes of the pictures to be used, this performs the 
above feature. Also, when the system is using the method of automatically placing 
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pictures in the layout, tlie system chooses, or identifies, a certain pre-determined size 
on the overall layout to place the picture on the layout to be printed. With this pre- 
detemnined space, the images chosen have a pre-determined print size and this size is 
taken into account when placing the images on the overall layout. The print size of the 
images is used to assist the system in arranging the Images in a more aesthetic 
manner. The images in the system have a pre-detennined print size since these 
images where taken by different sources (i.e. digital camera or scanner) and these 
different sources defined the print size for the images and therefore, the pre-determined 
print size feature is performed. The system may then normalize the pictures to take 
away the left over white space on the overall layout when these images are placed on 
the layout. With the system able to manually or automatically choose images to be 
placed on a layout, a last image that can fit a remaining space on the layout may be 
chosen. This image may be the largest pre-determined print size that is able to fit that 
particular space in the image. When looking at figure 14, the cross-hatched space may 
be used to fit a certain image and the image chosen may be the largest print size 
available to fit in that area. When the system is using the method of automatically 
placing pictures in the layout, the system chooses, or identifies, a certain pre- 
determined size on the overall layout to place the picture on the layout to be printed. In 
the system, an image may be identified as being much larger or smaller than the rest of 
the images. The image that is much larger than the others Is considered as the Image 
with the largest pre-determined print size. This image is identified when it is chosen to 
be placed on the layout and the smallest dimension of the image may be normalized In 
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order to create a spatial balance between itself and other images used in the system; 
see figs. 1-3; paragraphs [0046]-[0055] and [0057]-[0067]); 

if it will fit, packing a digital image of the identified largest pre-determined print 
size in a first orientation and continuing the open trial pack as a first child trial pack (i.e. 
the amount of images placed on a page is detennined automatically based on the layout 
and the amount of space that allows the images to achieve a spatial balance on the 
specified layout. If the image with a pre-detennined print size does not assist in 
creating a spatial balance or there is not enough room to fit an image on the page, that 
image is not chosen automatically to be placed on the page. When the first image with 
a pre-determined print size is chosen, another image with another pre-determined print 
size is chosen to see if the first images together will create a spatial balance. If the 
images together create a spatial balance, other images are chosen until the 
presentation of an image will take the overall page layout out of a spatial balance. Then 
a score is created to represent the amount of space left on the page layout. The 
process described above is an example of continuing the trial layout as a child trial 
pack. The images chosen can be have the smallest or largest pre-determined print 
size, but the process of normalization is used to assist in creating the spatial balance in 
the system so that the image sizes do not become a problem to the overall appearance 
of the layout; see fig. 5, 7 and 11-14; paragraphs [0049H0057]); and 

if it will fit, packing a digital image of the identified largest pre-determined print 
size in a second orientation and continuing the trial pack as a second child trial pack 
(i.e. during the process that is illustrated in figure 7, the above process that occurs to 
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the first or prior trial layout occurs to the new or the second trial layout. The new trial 
layout shows another orientation of the same images, which have the same pre- 
detennined print sizes, being used due to the specifications given by the aspect ratio of 
the page format. Also, the above process of the continuing of the trial layout as a first 
trial pack Is the same for the second trial layout. The second trial layout is continued as 
a second child trial pack; see fig. 5 and 7; paragraphs [0049]-[0057] and [0059]-[00631). 

Re claim 8: Simon et al discloses the method of claim 6, wherein: 

packing the digital image of the identified largest pre-detemnined print-size in the 
first orientation comprises packing as many digital images of the identified largest pre- 
determined print size as possible in the first orientation and continuing the open trial 
pack as a first child trial pack (i.e. the amount of Images placed on a page is determined 
automatically based on the layout and the amount of space that allows the Images to 
achieve a spatial balance on the specified layout. If the image does not assist in 
creating a spatial balance or there is not enough room to fit an image on the page, that 
image is not chosen automatically to be placed on the page. When the first image with 
a pre-determined print size is chosen, another image is chosen to see if the image sizes 
together will create a spatial balance. If the print sizes of the images together create a 
spatial balance, other images are chosen until the presentation of an image will take the 
overall page layout out of a spatial balance. Then a score is created to represent the 
amount of space left on the page layout. The process described above is an example 
of continuing the trial layout as a child trial pack. Regarding the largest pre-detennined 
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print size being chosen and packed, the images used can be the largest or the smallest 
in regards to the print size on the layout. The images may be the largest for the area 
designated on the layout for the Image to be placed as shown in figure 17; see fig. 5, 7 
and 11-14; paragraphs [0049H0055] and [0057H0067]); and 

packing the digital image of the identified largest pre-determined print-size in the 
second orientation comprises packing as many digital images of the identified largest 
pre-determined print size as possible in the second orientation and continuing the open 
trial pack as a second child trial pack (i.e. during the process that is illustrated in figure 
7, the above process that occurs to the first or prior trial layout occurs to the new or the 
second trial layout. The new trial layout shows another orientation of the same images, 
which has the same print sizes, being used due to the specifications given by the aspect 
ration of the page fomiat. Also, the above process of the continuing of the trial layout as 
a first trial pack is the same for the second trial layout. The second trial layout is 
continued as a second child trial pack; see fig. 5 and 7; paragraphs [0049]-[0055] and 
[0059]-[0063]). 

Re claim 9: Simon et al discloses the method of claim 8, wherein packing as many 
digital images of the Identified largest pre-detemiined print size as possible comprises 
repeatedly packing digital images of the identified largest pre-determined print size in a 
given orientation until either another digital image of the identified largest pre- 
detennined print size will not fit or no digital image of the identified largest pre- 
determined print size remains in the set (i.e. the invention finds images of certain sizes 
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that may fill the trial layout in an efficient manner. This may be a large or small sized 
image. The images chosen to fill the trial layout shown in figures 8-10 are either the 
same size or a different size and the feature of packing as many digital images of a 
certain size as possible in a certain orientation in a trial pack is performed. The images 
with certain print sizes are placed on the page layout until the images will not fit on the 
page in order to create a spatial balance. Also, because of the selection criteria listed in 
paragraph [0050], certain images do not remain since the images do not meet criteria 
set by the user. The other feature of no digital image of the identified size remains in 
the set is performed since the identified size may be associated with a time and date 
and if the image of the above time and date criteria does not remain, the above feature 
is performed. Regarding the largest pre-determined print size being chosen and packed, 
the images used can be the largest or the smallest in regards to the print size on the 
layout. The images may be the largest for the area designated on the layout for the 
image to be placed as shown in figure 17; see figs. 5-10; paragraphs [0049]-[0055] and 
[0059]). 

Re claim 10: Simon et al discloses the method of claim 6, wherein closing comprises, 
for each open trial pack, closing that pack if no digital image from the set that has yet to 
be packed in the open trial pack will fit in the packing area (i.e. when performing the 
process of comparing and accepting a page layout, the process of continuing to apply 
images to certain layouts and closing the process of adding images because the layouts 
have the appropriate amount of images on a page is repeated until a user decides to 
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accept a displayed layout. The trial layouts are closed when the images selected create 
a spatial balance and any more images added to the layout may disrupt the spatial 
balance in the page format chosen. Therefore, when a page layout cannot have any 
images added to the layout because any page added will not fit in order to keep a 
spatial balance, then the page layout is closed; see figs. 5 and 7; paragraphs [0049]- 
[00551). 

Re claim 11: Simon et al discloses a method of organizing digital images on a page, 
comprising: 

selecting a set of digital images, each digital image in the set having a pre- 
determined print size (i.e. in figure 5, the step 120 allows the images used to be 
arranged on a page format to be selected manually or automatically. Shown in the 
illustrated prior art image in figure 2 is a template with the identification of a pre- 
determined print size for each of the digital images to be used on the template. Since 
this template is used to identify pre-determined print sizes of the pictures to be used, 
this performs the above feature. Also, when the system is using the method of 
automatically placing pictures in the layout, the system chooses, or identifies, a certain 
pre-determined size on the overall layout to place the picture on the layout to be printed. 
With this pre-detemiined space, the images chosen have a pre-determined print size 
and this size is taken into account when placing the Images on the overall layout. The 
print size of the images is used to assist the system in arranging the images in a more 
aesthetic manner. The images in the system have a pre-determined print size since 
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these images where taken by different sources (i.e. digital camera or scanner) and 
these different sources defined the print size for the images and therefore, the pre- 
detemiined print size feature is performed. The system may then normalize the pictures 
to take away the left over white space on the overall layout when these images are 
placed on the layout; see fig. 5; paragraphs [0047]-[0057]); 

generating trial packs for the selected set of digital images (i.e. a trial layout is 
first determined when a layout of pictures is generated. Then another score layout is 
generated due to the rearrangement of the same photos in the previous layout. The 
cost function or white space scores are used to compare the two trial layouts and the 
scores are in relation to how much white space is left on the overall layout. The trial 
layout is considered as the trial pack; see figs. 6-10; paragraphs [0051H0061]); 

opening a trial pack as an empty page (i.e. figure 6 is an example of an empty 
trial layout. This shows a view of the page in which the pictures of figure 3 will be 
placed; see fig. 3 and 6; paragraphs [0038] and [0050]}; 

continuing, if possible, each open trial pack (i.e. the selection of the images 
placed on the trial layout are automatically selected bas^d on the width, height or 
aspect ratio of the page. With the images chosen automatically, the images are 
continually placed on the page to fit the format chosen and normalizing of the images 
also takes place. The normalizing ensures that the images are distanced from one 
another in an equivalent manner to create a spatial balance between the pictures; see 
fig. 5; paragraphs [0049]-[0055]) and closing each trial pack that cannot be continued 
(i.e. once normalizing takes place, the images are placed to create a spatial balance. 
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Once this Is sliown to tlie user for acceptance, the user has a choice to accept the 
layout or go through the page layout process again until an acceptable page layout is 
obtained. The layout process is completed or closed once the user is displayed the new 
layout; see fig. 5; paragraphs [0049]-[0055]); and 

repeating the steps of continuing and closing until no trial pack remains open (I.e. 
when perfoming the process of comparing accepting a page layout, the process of 
continuing to apply images to certain layouts and closing the process of adding images 
because the layouts have the appropriate amount of images on a page is repeated until 
a user decides to accept a displayed layout; see fig. 5; paragraphs [0049]-[0055]) 

comparing the trial closed packs (i.e. at step 240 in figure 7, the two trial layouts 
are compared to see which layout has a greater score in relation to the cost function or 
white space. These trial packs cannot have any more images placed on them and are 
therefore closed when compared; see figs. 6-10; paragraphs [0057]-[0061]); 

selecting a trial pack based upon the comparison (i.e. based on the comparison 
of the trial layouts and their associated scores, the trial layout with the lowest cost 
function or white space score is chosen; see figs. 6-10; paragraphs [0057H00611); and 

detemiinlng if any of the digital images from the set were not used in the selected 
trial pack, and If any digital images are determined to not be used, selecting the unused 
digital images as the set of digital images (i.e. in step 100. the digital images to be 
chosen are recognized to be in a database that stores the pictures. In step 120, Images 
that are detemriined to be on the database that are not packed on the current page 
layout, are selected to be placed on the page. This process can be performed manually 
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or automatically. The images that are chosen in step 120 are images that are not 
placed on the page layout before that step has occurred; see fig. 5; paragraphs [0049]- 
[0055]) and repeating the opening, continuing, closing, comparing, selecting, and 
detennining (i.e. when another trial layout is being compared to a previous trial layout, 
the steps of opening a new layout page, continuing to place the same images on the 
pages, closing the trial layout after another arrangement is created, comparing, 
selecting and detennining are perfomned again or repeated. A trial layout may be 
repeated over several times, as illustrated in figure 5, until a desirable layout is 
displayed to the user; see fig. 5 and 7; paragraphs [0049]-[0055] and [0059]-[0063]); 

wherein continuing comprises defining a packing area and upon detennining that 
at least one digital image from the set that has yet to be packed in the open trial pack 
will fit in the packing area (i.e. in the system, a given number of images are to be laid 
out on a certain page layout. The system ensures that this given number is met. If this 
given number is not met for the layout, the system makes the determination and then 
looks for the image to be placed on the page layout to fit the given number of images on 
the page layout. This is an example of the continuing function occurring in the system. 
If a user is dissatisfied with the current layout, the system may redefine new areas to 
pack images and place those image in the new areas for packing while making sure that 
the designated number of images to be placed on the overall layout is still performed; 
see figs. 5-10; paragraphs [0050]-[0064]): 

identifying a largest pre-determined print size of a digital image remaining in the 
set that will fit in the packing area (i.e. shown in the illustrated prior art image in figure 2 
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is a template with the identification of a pre-determined print size for each of the digital 
images to be used on the template. Since this template is used to identify pre- 
detennined print sizes of the pictures to be used, this performs the above feature. Also, 
when the system is using the method of automatically placing pictures in the layout, the 
system chooses, or identifies, a certain pre-detemnined size on the overall layout to 
place the picture on the layout to be printed. With this pre-determined space, the 
images chosen have a pre-determined print size and this size is taken into account 
when placing the images on the overall layout. The print size of the images is used to 
assist the system in arranging the images in a more aesthetic manner. The images in 
the system have a pre-detemnined print size since these images where taken by 
different sources (i.e. digital camera or scanner) and these different sources defined the 
print size for the images and therefore, the pre-determined print size feature is 
performed. The system may then normalize the pictures to take away the left over 
white space on the overall layout when these images are placed on the layout. With the 
system able to manually or automatically choose images to be placed on a layout, a last 
image that can fit a remaining space on the layout may be chosen. This image may be 
the largest pre-determined print size that is able to fit that particular space in the image. 
When looking at figure 14, the cross-hatched space may be used to fit a certain image 
and the image chosen may be the largest pririi size available to fit in that area. When 
the system is using the method of automatically placing pictures in the layout, the 
system chooses, or identifies, a certain pre-determined size on the overall layout to 
place the picture on the layout to be printed. In the system, an image may be identified 
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as being much larger or smaller than the rest of the images. The image that is much 
larger than the others Is considered as the image with the largest pre-determined print 
size. This image is identified when it is chosen to be placed on the layout and the 
smallest dimension of the image may be normalized in order to create a spatial balance 
between itself and other images used in the system; see figs. 1-3; paragraphs [0046]- 
[00551 and [00571-[0067]); 

if it will fit, packing a digital image of the identified largest pre-determined print 
size in a first orientation and continuing the open trial pack as a first child trial pack (i.e. 
the amount of images placed on a page is detennined automatically based on the layout 
and the amount of space that allows the images to achieve a spatial balance on the 
specified layout. If the image with a pre-determined print size does not assist in 
creating a spatial balance or there is not enough room to fit an image on the page, that 
image is not chosen automatically to be placed on the page. When the first image with 
a pre-determined print size is chosen, another image with another pre-determined print 
size is chosen to see if the first images together will create a spatial balance. If the 
images together create a spatial balance, other images are chosen until the 
presentation of an image will take the overall page layout out of a spatial balance. Then 
a score is created to represent the amount of space left on the page layout. The 
process described above is an example of continuing the trial layout as a child trial 
pack. The images chosen can be have the smallest or largest pre-determined print 
size, but the process of normalization is used to assist in creating the spatial balance in 
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the system so that the image sizes do not become a problem to the overall appearance 
of the layout; see fig. 5, 7 and 11-14; paragraphs [0049]-[0057]); and 

if it will fit. packing a digital image of the identified largest pre-determined print 
size in a second orientation and continuing the trial pack as a second child trial pack 
(i.e. during the process that is illustrated in figure 7, the above process that occurs to 
the first or prior trial layout occurs to the new or the second trial layout. The new trial 
layout shows another orientation of the same images, which have the same pre- 
detemiined print sizes, being used due to the specifications given by the aspect ratio of 
the page format. Also, the above process of the continuing of the trial layout as a first 
trial pack is the same for the second trial layout. The second trial layout is continued as 
a second child trial pack; see fig. 5 and 7; paragraphs [0049]-[0057] and I0059]-[0063]). 

Re claim 15: Simon et al discloses the method of claim 11, wherein: 

packing the digital image of the identified largest pre-determined print size in the 
first orientation comprises packing as many digital images of the identified pre- 
determined print size as possible in the first orientation and continuing the open trial 
pack as a first child trial pack (i.e. the amount of images placed on a page is determined 
automatically based on the layout and the amount of space that allows the images to 
achieve a spatial balance on the specified layout. If the image does not assist in 
creating a spatial balance or there is not enough room to fit an image on the page, that 
image is not chosen automatically to be placed on the page. When the first image with 
a pre-determined print size is chosen, another image is chosen to see if the image sizes 
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together will create a spatial balance. If the print sizes of the images together create a 
spatial balance, other images are chosen until the presentation of an image will take the 
overall page layout out of a spatial balance. Then a score is created to represent the 
amount of space left on the page layout. The process described above is an example 
of continuing the trial layout as a child trial pack. Regarding the largest pre-detemnined 
print size being chosen and packed, the images used can be the largest or the smallest 
in regards to the print size on the layout. The images may be the largest for the area 
designated on the layout for the image to be placed as shown in figure 17; see fig. 5, 7 
and 11-14; paragraphs [0049H0055] and [0057H0067]); and 

packing the digital image of the identified largest pre-determined print size in the 
second orientation comprises packing as many digital images of the identified pre- 
determined print size as possible in the second orientation and continuing the open trial 
pack as a second child trial pack (i.e. during the process that is illustrated in figure 7, the 
above process that occurs to the first or prior trial layout occurs to the new or the 
second trial layout. The new trial layout shows another orientation of the same images, 
which has the same print sizes, being used due to the specifications given by the aspect 
ration of the page fonriat. Also, the above process of the continuing of the trial layout as 
a first trial pack is the same for the second trial layout. The second trial layout is 
continued as a second child trial pack; see fig. 5 and 7; paragraphs [0049]-[0055] and 
[0059]-[00631). 
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Re claim 16: Simon et ai discloses the method of claim 15, wherein packing as many 
digital images of the identified pre-determined print size as possible comprises 
repeatedly packing digital images of the identified pre-determined print size in a given 
orientation until either another digital image of the identified pre-determined print size 
will not fit or no digital image of the identified pre-determined print size remains in the 
set (i.e. the invention finds images of certain sizes that may fill the trial layout in an 
efficient manner. This may be a large or small sized image. The images chosen to fill 
the trial layout shown in figures 8-10 are either the same size or a different size and the 
feature of packing as many digital images of a certain size as possible in a certain 
orientation in a trial pack is perfomied. The images with certain print sizes are placed 
on the page layout until the images will not fit on the page in order to create a spatial 
balance. Also, because of the selection criteria listed in paragraph [0050], certain 
images do not remain since the images do not meet criteria set by the user. The other 
feature of no digital image of the identified size remains in the set is performed since the 
identified size may be associated with a time and date and if the image of the above 
time and date criteria does not remain, the above feature is perfonned. Regarding the 
largest pre-determined print size being chosen and packed, the images used can be the 
largest or the smallest in regards to the print size on the layout. The images may be the 
largest for the area designated on the layout for the image to be placed as shown in 
figure 17; see figs. 5-10; paragraphs [0049]-[0055] and [0059]). 
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Re claim 17: Simon et a! discloses the method of claim 1 1 , wherein closing comprises, 
for each open trial pack, closing that pack if no digital image from the set that has yet to 
be packed in the open trial pack will fit in the packing area (i.e. when performing the 
process of comparing and accepting a page layout, the process of continuing to apply 
images to certain layouts and closing the process of adding images because the layouts 
have the appropriate amount of images on a page is repeated until a user decides to 
accept a displayed layout. The trial layouts are closed when the images selected create 
a spatial balance and any more images added to the layout may disrupt the spatial 
balance in the page format chosen. Therefore, when a page layout cannot have any 
images added to the layout because any page added will not fit in order to keep a 
spatial balance, then the page layout is closed; see figs. 5 and 7; paragraphs [00491- 
[0055]). 

Re claim 23: Simon et al discloses a computer readable medium having instructions for: 
identifying a set of digital images (i.e. in figure 5, the step 120 allows the images 
used to be arranged on a page format to be selected manually or automatically; see fig. 
5; paragraphs [0G49H0055]); 

Identifying a pre-detennined print size for each of the digital images In the set 
(i.e. shown in the illustrated prior art image in .'igure 2 is a template with the 
identification of a pre-detennined print size for each of the digital images to be used on 
the template. Since this template is used to identify pre-determined print sizes of the 
pictures to be used, this performs the above feature. Also, when the system is using 
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the method of automatically placing pictures in the layout, the system chooses, or 
Identifies, a certain pre-determined size on the overall layout to place the picture on the 
layout to be printed. With this pre-detennined space, the images chosen have a pre- 
detemiined print size and this size is taken into account when placing the images on the 
overall layout. The print size of the images is used to assist the system in arranging the 
images in a more aesthetic manner. The images in the system have a pre-determined 
print size since these images where taken by different sources (i.e. digital camera or 
scanner) and these different sources defined the print size for the images and therefore, 
the pre-determined print size feature is perfomned. The system may then normalize the 
pictures to take away the left over white space on the overall layout when these images 
are placed on the layout; see figs. 1-3; paragraphs [0046]-[0055]); 

defining a packing area (i.e. when the fonnat of a page is selected in step 110, 
this is analogous to defining a packing area. In this step, the height and width of the 
page Is specified in order to define where and within a format the images are to be 
placed on the page; see fig. 5 and 6; paragraph [0049] and [0050]); 

identifying a largest of the predetermined print sizes (i.e. shown in the illustrated 
prior art image in figure 2 is a template with the identification of a pre-determined print 
size for each of the digital images to be used on the template. Since this template is 
used to identify pre-determined print sizes of the pictures to be used, this performs the 
above feature. When the system is using the method of automatically placing pictures 
in the layout, the system chooses, or identifies, a certain pre-determined size on the 
overall layout to place the picture on the layout to be printed. In the system, an image 
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may be identified as being much larger or smaller than the rest of the images. The 
Image that is much larger than the others is considered as the image with the largest 
pre-determined print size. This image is identified when it is chosen to be placed on the 
layout and the smallest dimension of the image may be normalized in order to create a 
spatial balance between itself and other images used in the system; see figs. 1-3; 
paragraphs [0046]-[0055]); 

if it will fit in the packing area, packing a digital image from the set having the 
identified largest pre-detemiined print size set in a first orientation in the packing area in 
a first trial pack (i.e. the amount of images placed on a page is detemnined automatically 
based on the layout and the amount of space that allows the images to achieve a 
spatial balance on the specified layout. If the image does not assist in creating a spatial 
balance or there is not enough room to fit an image on the page, the current image is 
not chosen automatically to be placed on the page. The system determines the size of 
an area to place an image and judges whether that area should be packed with the 
image that will not overlap other images. This image has a certain print size that needs 
to be taken into account before placing the image In a certain place with other images. 
With this process being performed, this is an example of identifying an image with a pre- 
detennined print size to place on the layout in order for the image to not be overlapping 
other images. Once the image is placed, it can be determined that this image is the 
largest image placed on the layout compared to the rest of the images. Next, the 
normalizing process occurs to make sure that the image that is the largest is normalized 
in some manner to create a better spatial balance in the layout and the amount of white 



Application/Control Number: 1 0/620,505 Page 33 

Art Unit: 2625 

space on the layout is minimized. Also, this process occurs until there can not be any 
more images laid out on the trial layout and a score is calculated for the trial layout; see 
fig. 7 and 11-14; paragraphs [0049H0055]); and 

if it will fit in the packing area, packing the digital image from the set having the 
identified largest pre-determined print size in the second orientation in the packing area 
in a second trial pack (i.e. during the process that is illustrated in figure 7, the above 
process that occurs to the first or prior trial layout occurs to the new or the second trial 
layout. The new trial layout shows another orientation of the same images being used 
due to the specifications given by the aspect ration of the page format. Like the above 
explanation, this same system again detemiines the size of an area to place an image 
and judges whether that area should be packed with the image for another trial layout if 
the user has expressed dissatisfaction or the system compares to layouts with different 
scores. In this second layout, again the images with a pre-determined print size are 
placed on the layout and these images are placed in a manner that will provide ample 
space for the image to be placed and not overlap any other images in the layout, and a 
normalizing process may occur to assist in improving the visual aspect of the layout. 
This process also again occurs until there can not be any more images laid out on the 
trail layout and a score is calculated for the trial layout; see fig. 7; paragraphs [0049]- 
[0055] and [0057]-[0063]). 

Re claim 24: Simon et al discloses the medium of claim 23, having further instruction 
for: 
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identifying a largest image size that will fit in the packing area (i.e. although 
identifying the largest size is not specifically disclosed, it is performed by the device. 
With normalization, the largest sized image is isotropically scaled so that the shortest 
dimension of the image is equivalent to the other images used in the page format. The 
image with a certain size, which is identified, is the image that will create a spatial 
balance in the page format. This image can be the largest or the smallest size. The 
image will still be nomialized to fit the image together with the other images to have the 
page format displayed to the user in a balanced manner; see figs. 5-10; paragraph 
[0050]-[0055]); and 

wherein the instructions for packing the digital image in the first orientation 
include instructions for, if the digital image from the set having the identified pre- 
detennined print size will fit in the first orientation, packing as many digital images from 
the set having the identified pre-determined print size as possible in the first trial pack 
(i.e. the invention finds images of certain sizes that may fill the trial layout in an efficient 
manner. This may be a large or small sized image. The images chosen to fill the trial 
layout shown in figures 8-10 are either the same size or a different size and the feature 
of packing as many digital images of a certain size as possible in a certain orientation in 
a trial pack is performed. The images in the system that are used have a pre- 
determined size to be printed on the layout. The images are placed on the layout with a 
pre-determined size and these sizes can be the largest or the smallest to be placed and 
printed on the overall layout. The invention can pack large images, compared to other 
images, on a layout as long as the images do not overlap. These images can be 
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packed until no other images can be placed on the layout anymore. Then, the process 
of normalization may occur to make the overall layout have a better aesthetic look; see 
figs. 5-10; paragraphs [0049H0057] and [0059]); and 

wherein the instructions for packing the digital image in the second orientation 
include instructions for, if the digital image from the set having the identified largest pre- 
detemiined print size will fit in the second orientation, packing as many digital images 
from the set having the identified largest pre-determined print size as possible in the 
second orientation in the second trial pack (i.e. when comparing which trial layout is the 
most efficient in figure 7, the same process that occun-ed to the first or prior trial layout 
also occurs to the new or second trial layout. The second trial layout is another 
orientation of the same images and therefore, the above feature is also perfomied. 
Since the same process for the first orientation occurs for the second orientation, the 
feature of identifying a set of images to place within a pre-determined print space is also 
performed. Like in the first orientation, the images in the system that are used have a 
pre-determined size to be printed on the layout. The images are placed on the layout 
with a pre-detemnined size and these sizes can be the largest or the smallest to be 
placed and printed on the overall layout. The invention can pack large images, 
compared to other images, on a layout as long as the images do not overiap. These 
images can be packed until no other images can be placed on the layout anymore. 
Then, the process of normalization may occur to make the overall layout have a better 
aesthetic lo; see fig. 5-10; paragraphs [0049]-[0055] and [0059]-[0063]). 
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Re claim 25: Simon et al discloses the medium, wherein the instructions for: 

identifying a largest of the pre-determined print sizes (i.e. shown in the illustrated 
prior art image in figure 2 is a template with the identification of a pre-determined print 
size for each of the digital images to be used on the template. Since this template is 
used to identity pre-detennined print sizes of the pictures to be used, this perfomis the 
above feature. When the system is using the method of automatically placing pictures 
in the layout, the system chooses, or identifies, a certain image with pre-detennined 
size to be placed on the overall layout to be printed. The image can be the largest or 
the smallest image out of the images chosen. This performs the feature of identitying 
an image with the largest pre-determined print size to be placed in the layout and 
placing the image or images on the page. The system may then normalize the pictures 
to take away the left over white space on the overall layout; see figs. 1-3; paragraphs 
[0046]-[0055]), comprises 

instructions for identitying, from a set of digital images, a largest pre-determined 
print size that will fit in the packing area (i.e. although identifying the largest pre- 
detennined print size is not specifically disclosed, it is perfomied by the device. With 
normalization, the largest sized image is isotropically scaled so that the shortest 
dimension of the image is equivalent to the other images used in the page fonnat. The 
image with a certain size, which is identified, is the image that will create a spatial 
balance in the page format. This image can be the largest or the smallest size. The 
image will still be normalized to fit the image together with the other images to have the 
page fonnat displayed to the user In a balanced manner. With the system automatically 
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identifying the image with the largest pre-determined print size in group of chosen 
images to use, the system takes this information in order to figure out a way to 
normalize the image so that the image does not dominate the entire image. This is an 
example of identifying the largest pre-determined print size of an image, packing the 
image in the layout, but also normalizing the image so that it does not dominate the 
overall layout. The image identified is considered to have a pre-determined print size 
since the source of the image determined the size of the image before the image was 
actually used in the current system shown in figure 1 to organize and pack images on a 
layout; see figs. 5-10; paragraph [00501-[0057]); and 

packing as many digital images of the identified largest pre-detennined print size 
as possible comprises repeatedly packing digital images of the identified largest pre- 
determined print size in a given orientation until either another digital image of the 
identified largest pre-determined print size will not fit or no digital image of the identified 
largest pre-determined print size remains in the set (i.e. the invention finds images of 
certain sizes that may fill the trial layout in an efficient manner. This may be a large or 
small sized image. The images chosen to fill the trial layout shown in figures 8-10 are 
either the same size or a different size and the feature of packing as many digital 
images of a certain size as possible in a certain orientation in a trial pack is performed. 
The images are placed on the page layout until the images will not fit on the page in 
order to create a spatial balance. Also, because of the selection criteria listed in 
paragraph [0050], certain images do not remain since the images do not meet criteria 
set by the user. The other feature of no digital image of the identified size remains in 
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the set is performed since the identified size may be associated with a time and date 
and if the image of the above time and date criteria does not remain, the above feature 
is performed. With the system automatically identifying the image with the largest pre- 
determined print size in group of chosen images to use, the system takes this 
information in order to figure out a way to nomialize the image so that the image does 
not dominate the entire image. This is an example of identifying the largest pre- 
detenmined print size of an image, packing the image in the layout, but also normalizing 
the image so that it does not dominate the overall layout. With the images identified, 
one, a couple, or all of the images may be considered as the largest in print size if these 
images are compared to the other images used in making up the layout. The images 
identified are considered to have a pre-detennined print size since the source of the 
images determined the sizes of the images before the images were actually used in the 
current system shown in figure 1 to organize and pack images on a layout; see figs. 5- 
10; paragraphs [0049]-[0055] and [0059]). 

Re claim 26: Simon et al discloses a computer readable medium having instructions for: 

selecting a set of digital images, each digital image in the set having a pre- 
detennined print size (i.e. in figure 5, the step 120 allows the images used to be 
arranged on a page format to be selected manually or automatically. Shown in the 
illustrated prior art image in figure 2 is a template with the identification of a pre- 
detemiined print size for each of the digital images to be used on the template. Since 
this template is used to identify pre-determined print sizes of the pictures to be used, 



Application/Control Number: 1 0/620,505 Page 39 

Art Unit: 2625 

this performs the above feature. Also, when the system is using the method of 
automatically placing pictures in the layout, the system chooses, or identifies, a certain 
pre-determined size on the overall layout to place the picture on the layout to be printed. 
With this pre-determined space, the images chosen have a pre-detemfiined print size 
and this size is taken into account when placing the images on the overall layout. The 
print size of the images is used to assist the system in arranging the images in a more 
aesthetic manner. The images in the system have a pre-determined print size since 
these images where taken by different sources (i.e. digital camera or scanner) and 
these different sources defined the print size for the images and therefore, the pre- 
determined print size feature is performed. The system may then normalize the pictures 
to take away the left over white space on the overall layout when these images are 
placed on the layout; see fig. 5; paragraphs [0047]-[0057J); 

opening a trial pack as an empty page (i.e. figure 6 is an example of an empty 
trial layout.- This shows a view of the page in which the pictures of figure 3 will be 
placed; see fig. 3 and 6; paragraphs [0038] and [0050]); 

continuing, if possible, each open trial pack (i.e. the selection of the images 
placed on the trial layout are automatically selected based on the width, height or 
aspect ratio of the page. With the images chosen automatically, the images are 
continually placed on the page to fit the format chosen and normalizing of the images 
also takes place. The normalizing ensures that the images are distanced from one 
another in an equivalent manner to create a spatial balance between the pictures; see 
fig. 5; paragraphs [0049]-[0055]) and closing each trial pack that cannot be continued 
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(i.e. once normalizing takes place, the images are placed to create a spatial balance. 
Once this is shown to the user for acceptance, the user has a choice to accept the 
layout or go through the page layout process again until an acceptable page layout is 
obtained. The layout process is completed or closed once the user is displayed the new 
layout; see fig. 5; paragraphs [0049H0055]); and 

repeating the continuing and closing until no trial pack remains open (i.e. when 
performing the process of comparing accepting a page layout, the process of continuing 
to apply images to certain layouts and closing the process of adding images because 
the layouts have the appropriate amount of images on a page is repeated until a user 
decides to accept a displayed layout; see fig. 5; paragraphs [0049H0055]); 

wherein the instructions for continuing include instructions for, upon detemiining 
that at least one digital image from the set that has yet to be packed in the open trial 
pack will fit in the packing area (i.e. in the system, a given number of images are to be 
laid out on a certain page layout. The system ensures that this given number is met. If 
this given number is not met for the layout, the system makes the determination and 
then looks for the image to be placed on the page layout to fit the given number of 
images on the page layout. This is an example of the continuing function occurring in 
the system. If a user is dissatisfied with the current layout, the system may redefine 
new areas to pack images and place those in^age in the new areas for packing while 
making sure that the designated number of images to be placed on the overall layout is 
still performed; see figs. 5-10; paragraphs [0050]-[0064]): 
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identifying a largest pre-detemnined print size of a digital image remaining In the 
set that will fit in the packing area (i.e. shown in the illustrated prior art image in figure 2 
is a template with the identification of a pre-determined print size for each of the digital 
images to be used on the template. Since this template is used to identify pre- 
detemiined print sizes of the pictures to be used, this perfomns the above feature. Also, 
when the system is using the method of automatically placing pictures in the layout, the 
system chooses, or identifies, a certain pre-determined size on the overall layout to 
place the picture on the layout to be printed. With this pre-detemnined space, the 
images chosen have a pre-determined print size and this size is taken into account 
when placing the images on the overall layout. The print size of the images is used to 
assist the system in arranging the images in a more aesthetic manner. The images in 
the system have a pre-detemilned print size since these images where taken by 
different sources (i.e. digital camera or scanner) and these different sources defined the 
print size for the images and therefore, the pre-determined print size feature is 
performed. The system may then normalize the pictures to take away the left over 
white space on the overall layout when these images are placed on the layout. With the 
system able to manually or automatically choose images to be placed on a layout, a last 
image that can fit a remaining space on the layout may be chosen. This image may be 
the largest pre-detemnined print size that is able to fit that particular space in the image. 
When looking at figure 14, the cross-hatched space may be used to fit a certain image 
and the image chosen may be the largest print size available to fit in that area. When 
the system is using the method of automatically placing pictures in the layout, the 
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system chooses, or identifies, a certain pre-deterniined size on the overall layout to 
place the picture on the layout to be printed. In the system, an image may be identified 
as being much larger or smaller than the rest of the images. The image that is much 
larger than the others is considered as the image with the largest pre-determined print 
size. This image is identified when it is chosen to be placed on the layout and the 
smallest dimension of the image may be normalized in order to create a spatial balance 
between itself and other images used in the system; see figs. 1-3; paragraphs [0046]- 
[0055] and [0057]-[0067]); 

if it will fit, packing a digital image of the identified largest pre-detemiined print 
size in a first orientation and continuing the open trial pack as a first child trial pack (i.e. 
the amount of images placed on a page is determined automatically based on the layout 
and the aniount of space that allows the images to achieve a spatial balance on the 
specified layout. If the image with a pre-determined print size does not assist in 
creating a spatial balance or there is not enough room to fit an image on the page, that 
image is not chosen automatically to be placed on the page. When the first image with 
a pre-determined print size is chosen, another image with another pre-detennined print 
size is chosen to see if the first images together will create a spatial balance. If the 
images together create a spatial balance, other Images are chosen until the 
presentation of an image will take the overall page layout out of a spatial balance. Then 
a score is created to represent the amount of space left on the page layout. The 
process described above is an example of continuing the trial layout as a child trial 
pack. The images chosen can be have the smallest or largest pre-detennined print 
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size, but the process of normalization is used to assist in creating the spatial balance in 
the system so that the image sizes do not become a problem to the overall appearance 
of the layout; see fig. 5, 7 and 11-14; paragraphs [0049]-[00571); and 

if it will fit, packing a digital image of the identified largest pre-detemnined print 
size in a second orientation and continuing the trial pack as a second child trial pack 
(i.e. during the process that is illustrated in figure 7, the above process that occurs to 
the first or prior trial layout occurs to the new or the second trial layout. The new trial 
layout shows another orientation of the same images, which have the same pre- 
detemiined print sizes, being used due to the specifications given by the aspect ratio of 
the page format. Also, the above process of the continuing of the trial layout as a first 
trial pack is the same for the second trial layout. The second trial layout is continued as 
a second child trial pack; see fig. 5 and 7; paragraphs [0049]-[00571 and [0059H0063]). 

Re claim 28: Simon et al discloses the medium, wherein the instructions for: 

packing the digital image of the identified largest pre-detennined print size in the 
first orientation include instructions for packing as many digital images of the identified 
largest pre-determined print size as possible in the first orientation and continuing the 
open trial pack as a first child trial pack (i.e. the amount of images placed on a page is 
determined automatically based on the layout and the amount of space that allows the 
images to achieve a spatial balance on the specified layout. If the image does not 
assist in creating a spatial balance or there is not enough room to fit an image on the 
page, that image is not chosen automatically to be placed on the page. When the first 
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Image with a pre-determined print size is chosen, another image is chosen to see if the 
image sizes together will create a spatial balance. If the print sizes of the images 
together create a spatial balance, other images are chosen until the presentation of an 
image will take the overall page layout out of a spatial balance. Then a score is created 
to represent the amount of space left on the page layout. The process described above 
is an example of continuing the trial layout as a child trial pack. Regarding the largest 
pre-determined print size being chosen and packed, the images used can be the largest 
or the smallest in regards to the print size on the layout. The images may be the largest 
for the area designated on the layout for the image to be placed as shown in figure 17; 
see fig. 5, 7 and 1 1-14; paragraphs [0049H00551 and [0057]-[0067]); and 

packing the digital image of the identified largest pre-determined print size in the 
second orientation include instructions for packing as many digital images of the 
identified largest pre-determined print size as possible in the second orientation and 
continuing the open trial pack as a second child trial pack (i.e. during the process that is 
illustrated in figure 7, the above process that occurs to the first or prior trial layout 
occurs to the new or the second trial layout. The new trial layout shows another 
orientation of the same images, which has the same print sizes, being used due to the 
specifications given by the aspect ration of the page format. Also, the above process of 
the continuing of the trial layout as a first trial pack is the same for the second trial 
layout. The second trial layout is continued as a second child trial pack; see fig. 5 and 
7; paragraphs [0049H0055] and [0059]-[0063]). 
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Re claim 29: Simon et al discloses the medium of claim 28, wherein the instructions for 
packing as many digital images of the identified largest pre-determined print size as 
possible include Instructions for repeatedly packing digital images of the identified 
largest pre-determined print size in a given orientation until either another digital image 
of the Identified largest pre-determined print size will not fit or no digital image of the 
identified largest pre-determined print size remains in the set (i.e. the invention finds 
Images of certain sizes that may fill the trial layout In an efficient manner. This may be a 
large or small sized image. The images chosen to fill the trial layout shown in figures 8- 
10 are either the same size or a different size and the feature of packing as many digital 
Images of a certain size as possible in a certain orientation In a trial pack is performed. 
The images with certain print sizes are placed on the page layout until the Images will 
not fit on the page in order to create a spatial balance. Also, because of the selection 
criteria listed in paragraph [0050], certain images do not remain since the images do not 
meet criteria set by the user. The other feature of no digital image of the identified size 
remains in the set is performed since the identified size may be associated with a time 
and date and if the Image of the above time and date criteria does not remain, the 
above feature Is performed. Regarding the largest pre-determined print size being 
chosen and packed, the images used can be the largest or the smallest in regards to 
the print size on the layout. The images may be the largest for the area designated on 
the layout for the image to be placed as shown in figure 17; see figs. 5-10; paragraphs 
[0049H0055] and [0059]). 
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Re claim 30: Simon et al discloses the medium of claim 26, wherein the instructions for 
closing include instructions for, for each open trial pack, closing that pack if no digital 
image from the set that has yet to be packed in the open trial pack will fit in the packing 
area (i.e. when performing the process of comparing and accepting a page layout, the 
process of continuing to apply images to certain layouts and closing the process of 
adding images because the layouts have the appropriate amount of images on a page 
is repeated until a user decides to accept a displayed layout. The trial layouts are 
closed when the images selected create a spatial balance and any more images added 
to the layout may disrupt the spatial balance in the page format chosen. Therefore, 
when a page layout cannot have any images added to the layout because any page 
added will not fit in order to keep a spatial balance, then the page layout is closed; see 
figs. 5 and 7; paragraphs [0049]-[00551). 

Re claim 31: Simon et al discloses a computer readable medium having instructions for 

selecting a set of digital images, each digital image in the set having a pre- 
determined print size (I.e. in figure 5, the step 120 allows the images used to be 
arranged on a page format to be selected manually or automatically. Shown in the 
illustrated prior art image in figure 2 is a template with the identification of a pre- 
detemiined print size for each of the digital images to be used on the template. Since 
this template is used to identify pre-detemined print sizes of the pictures to be used, 
this performs the above feature. Also, when the system is using the method of 
automatically placing pictures in the layout, the system chooses, or identifies, a certain 



Application/Control Number: 1 0/620,505 Page 47 

Art Unit: 2625 

pre-determined size on the overall layout to place the picture on the layout to be printed. 
With this pre-determined space, the images chosen have a pre-determined print size 
and this size is taken into account when placing the images on the overall layout. The 
print size of the images is used to assist the system in arranging the images in a more 
aesthetic manner. The images in the system have a pre-detemiined print size since 
these images where taken by different sources (i.e. digital camera or scanner) and 
these different sources defined the print size for the images and therefore, the pre- 
determined print size feature is performed. The system may then normalize the pictures 
to take away the left over white space on the overall layout when these images are 
placed on the layout; see fig. 5; paragraphs I0047]-[0057]); 

opening a trial pack as an empty page (i.e. figure 6 is an example of an empty 
trial layout. This shows a view of the page in which the pictures of figure 3 will be 
placed; see fig. 3 and 6; paragraphs [0038] and [0050]); 

continuing, if possible, each open trial pack (i.e. the selection of the images 
placed on the trial layout are automatically selected based on the width, height or 
aspect ratio of the page. With the images chosen automatically, the images are 
continually placed on the page to fit the format chosen and normalizing of the images 
also takes place. The normalizing ensures that the images are distanced from one 
another in an equivalent manner to create a spatial balance between the pictures; see 
fig. 5; paragraphs [0049]-[0055]) and closing each trial pack that cannot be continued 
(i.e. once normalizing takes place, the images are placed to create a spatial balance. 
Once this is shown to the user for acceptance, the user has a choice to accept the 
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layout or go through the page layout process again until an acceptable page layout is 
obtained. The layout process is completed or closed once the user is displayed the new 
layout; see fig. 5; paragraphs [0049]-[0055]); and 

repeating the steps of continuing and closing until no trial pack remains open (i.e. 
when performing the process of comparing accepting a page layout, the process of 
continuing to apply images to certain layouts and closing the process of adding images 
because the layouts have the appropriate amount of images on a page is repeated until 
a user decides to accept a displayed layout; see fig. 5; paragraphs [0049]-[00551) 

comparing the trial packs (i.e. at step 240 in figure 7, the two trial layouts are 
compared to see which layout has a greater score in relation to the cost function or 
white space; see figs. 6-10; paragraphs [0057H0061]); 

selecting a trial pack based upon the comparison (i.e. based on the comparison 
of the trial layouts and their associated scores, the trial layout with the lowest cost 
function or white space score is chosen; see figs. 6-10; paragraphs [0057]-I0061]); and 

determining if any of the digital images from the set were not used in the selected 
trial pack, and if any digital images are determined to not be used, selecting the unused 
digital images as the set of digital images (i.e. in step 100, the digital images to be 
chosen are recognized to be in a database that stores the pictures. In step 120, images 
that are detemriined to be on the database that are not packed on a page layout, are 
selected to be placed on a page. This process can be performed manually or 
automatically. The images that are chosen in step 120 are images that are not placed 
on the page layout before that step has occurred; see fig. 5; paragraphs [0049]-[00551) 
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and repeating the opening, continuing, closing, comparing, selecting, and determining 
(i.e. when another trial layout is being compared to a previous trial layout, the steps of 
opening a new layout page, continuing to place the same images on the pages, closing 
the trial layout after another arrangement is created, comparing, selecting and 
detemnining are perfonned again or repeated. A trial layout may be repeated over 
several times, as illustrated in figure 5, until a desirable layout is displayed to the user; 
see fig. 5 and 7; paragraphs [0049]-[0055] and [0059]-[0063]); 

wherein the instructions for continuing include instructions for defining a packing 
area and upon determining that at least one digital image from the set that has yet to be 
packed in the open trial pack will fit in the packing area (i.e. in the system, a given 
number of images are to be laid out on a certain page layout. The system ensures that 
this given number is met. If this given number is not met for the layout, the system 
makes the determination and then looks for the image to be placed on the page layout 
to fit the given number of images on the page layout. This is an example of the 
continuing function occurring in the system. If a user is dissatisfied with the current 
layout, the system may redefine new areas to pack images and place those image In 
the new areas for packing while making sure that the designated number of images to 
be placed on the overall layout is still performed; see figs. 5-10; paragraphs [0050]- 
[0064]): 

identifying a largest pre-detemriined print size of a digital image remaining in the 
set that will fit in the packing area (i.e. shown in the illustrated prior art image in figure 2 
is a template with the identification of a pre-determined print size for each of the digital 
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images to be used on the template. Since this template is used to identify pre- 
determined print sizes of the pictures to be used, this performs the above feature. Also, 
when the system is using the method of automatically placing pictures in the layout, the 
system chooses, or identifies, a certain pre-determined size on the overall layout to 
place the picture on the layout to be printed. With this pre-detemilned space, the 
images chosen have a pre-determined print size and this size is taken into account 
when placing the images on the overall layout. The print size of the images is used to 
assist the system in arranging the images in a more aesthetic manner. The images in 
the system have a pre-detennined print size since these images where taken by 
different sources (i.e. digital camera or scanner) and these different sources defined the 
print size for the images and therefore, the pre-detemriined print size feature is 
performed. The system may then normalize the pictures to take away the left over 
white space on the overall layout when these images are placed on the layout. With the 
system able to manually or automatically choose images to be placed on a layout, a last 
image that can fit a remaining space on the layout may be chosen. This image may be 
the largest pre-detennined print size that is able to fit that particular space in the image. 
When looking at figure 14, the cross-hatched space may be used to fit a certain image 
and the image chosen may be the largest print size available to fit in that area. When 
the system is using the method of automatically placing pictures in the layout, the 
system chooses, or identifies, a certain pre-determined size on the overall layout to 
place the picture on the layout to be printed. In the system, an image may be identified 
as being much larger or smaller than the rest of the images. The image that is much 
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larger than the others Is considered as the image with the largest pre-detemnined print 
size. This image is identified when it is chosen to be placed on the layout and the 
smallest dimension of the Image may be normalized in order to create a spatial balance 
between itself and other images used in the system; see figs. 1-3; paragraphs [0046]- 
[0055] and [0057]-[0067]); 

if it will fit, packing a digital image of the identified largest pre-determined print 
size in a first orientation and continuing the open trial pack as a first child trial pack (I.e. 
the amount of images placed on a page is determined automatically based on the layout 
and the amount of space that allows the images to achieve a spatial balance on the 
specified layout. If the image with a pre-detemnined print size does not assist In 
creating a spatial balance or there Is not enough room to fit an Image on the page, that 
image is not chosen automatically to be placed on the page. When the first image with 
a pre-determined print size is chosen, another image with another pre-determined print 
size is chosen to see if the first Images together will create a spatial balance. If the 
Images together create a spatial balance, other images are chosen until the 
presentation of an image will take the overall page layout out of a spatial balance. Then 
a score is created to represent the amount of space left on the page layout. The 
process described above is an example of continuing the trial layout as a child trial 
pack. The images chosen can be have the smallest or largest pre-determined print 
size, but the process of nomialization is used to assist In creating the spatial balance in 
the system so that the image sizes do not become a problem to the overall appearance 
of the layout; see fig. 5, 7 and 11-14; paragraphs [0049]-[0057]); and 
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if it will fit, packing a digital Infiage of the identified largest pre-determined print 
size in a second orientation and continuing the trial pack as a second child trial pack 
(i.e. during the process that is illustrated in figure 7, the above process that occurs to 
the first or prior trial layout occurs to the new or the second trial layout. The new trial 
layout shows another orientation of the same images, which have the same pre- 
determined print sizes, being used due to the specifications given by the aspect ratio of 
the page format. Also, the above process of the continuing of the trial layout as a first 
trial pack is the same for the second trial layout. The second trial layout is continued as 
a second child trial pack; see fig. 5 and 7; paragraphs [0049]-[0057] and [0059H0063]). 

Re claim 35: Simon et al discloses the medium, wherein: 

the instructions for packing the digital image of the Identified largest pre- 
detemriined print size in the first orientation include instructions for packing as many 
digital images of the identified pre-determined print size as possible in the first 
orientation and continuing the open trial pack as a first child trial pack (i.e. the amount of 
images placed on a page is determined automatically based on the layout and the 
amount of space that allows the images to achieve a spatial balance on the specified 
layout. If the Image does not assist in creating a spatial balance or there is not enough 
room to fit an image on the page, that image is not chosen automatically to be placed 
on the page. When the first Image with a pre-determined print size is chosen, another 
image is chosen to see if the image sizes together will create a spatial balance. If the 
print sizes of the images together create a spatial balance, other images are chosen 
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until the presentation of an image will take the overall page layout out of a spatial 
balance. Then a score is created to represent the amount of space left on the page 
layout. The process described above is an example of continuing the trial layout as a 
child trial pack. Regarding the largest pre-determined print size being chosen and 
packed, the images used can be the largest or the smallest in regards to the print size 
on the layout. The images may be the largest for the area designated on the layout for 
the image to be placed as shown in figure 17; see fig. 5, 7 and 11-14; paragraphs 
[0049H0055] and [0057]-[00671); and 

the instructions for packing the digital image of the identified largest pre- 
determined print size in the second orientation include instructions for packing as many 
digital images of the identified pre-determined print size as possible in the second 
orientation and continuing the open trial pack as a second child trial pack (i.e. during the 
process that is illustrated in figure 7, the above process that occurs to the first or prior 
trial layout occurs to the new or the second trial layout. The new trial layout shows 
another orientation of the same images, which has the same print sizes, being used due 
to the specifications given by the aspect ration of the page fomriat. Also, the above 
process of the continuing of the trial layout as a first trial pack is the same for the 
second trial layout. The second trial layout is continued as a second child trial pack; 
see fig. 5 and 7; paragraphs [0049]-[0055] and [0059]-[0063]). 

Re claim 36: Simon et al discloses the medium, wherein the instructions for packing as 
many digital images of the identified pre-detemnined print size as possible include 
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instructions for repeatedly pacl^ing digital images of the identified pre-detemnined print 
size in a given orientation until either another digital image of the identified pre- 
determined print size will not fit or no digital image of the identified pre-determined print 
size remains in the set (i.e. the invention finds images of certain sizes that may fill the 
trial layout in an efficient manner. This may be a large or small sized image. The 
images chosen to fill the trial layout shown in figures 8-10 are either the same size or a 
different size and the feature of packing as many digital images of a certain size as 
possible in a certain orientation in a trial pack is performed. The images with certain 
print sizes are placed on the page layout until the images will not fit on the page in order 
to create a spatial balance. Also, because of the selection criteria listed in paragraph 
[0050], certain images do not remain since the images do not meet criteria set by the 
user. The other feature of no digital image of the identified size remains in the set is 
performed since the identified size may be associated with a time and date and if the 
image of the above time and date criteria does not remain, the above feature is 
performed. Regarding the largest pre-determined print size being chosen and packed, 
the images used can be the largest or the smallest in regards to the print size on the 
layout. The images may be the largest for the area designated on the layout for the 
image to be placed as shown in figure 17; see figs. 5-10; paragraphs [0049]-[0055] and 
[0059]). 

Re claim 37: Simon et al discloses the medium of claim 31 , wherein the instructions for 
closing Include instructions for, for each open trial pack, closing that pack If no digital 
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image from the set that has yet to be packed in the open trial pack will fit in the packing 
area (i.e. when performing the process of comparing and accepting a page layout, the 
process of continuing to apply images to certain layouts and closing the process of 
adding images because the layouts have the appropriate amount of images on a page 
is repeated until a user decides to accept a displayed layout. The trial layouts are 
closed when the images selected create a spatial balance and any more images added 
to the layout may disrupt the spatial balance in the page fomiat chosen. Therefore, 
when a page layout cannot have any images added to the layout because any page 
added will not fit in order to keep a spatial balance, then the page layout is closed; see 
figs. 5 and 7; paragraphs [0049H0055]). 

Re claim 43: Simon et al discloses a method of organizing digital images on a page, 
comprising 

a trial pack generator (i.e. a trial layout is first determined when a layout of 
pictures is generated. Then another score layout is generated due to the 
rearrangement of the same photos in the previous layout. The cost function or white 
space scores are used to compare the two trial layouts and the scores are in relation to 
how much white space is left on the overall layout. The trial layout is considered as the 
trial pack. Although a trial pack generator is not specifically disclosed, the feature is 
perfomied; see figs. 6-10; paragraphs [0051]-[0061]); 

and a pack selector (i.e. in the system, depending on the score of the layout, a 
user or the system can selector a trial pack with the image packed in the trial pack. This 
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performs the feature of a pack selector; see figs. 5-10; paragraphs [0049]-[00641) 
wherein: 

define a packing areas (I.e. when the format of a page Is selected In step 1 1.0, 
this Is analogous to defining a packing area. In this step, the height and width of the 
page is specified in order to define where and within a fornnat the Images are to be 
placed on the page. Once an image Is placed, the system has to determine which 
section In the Image area should be used to place the next image. In the prior art 
section mentioned, figure 2 Is described to define packing areas; see figs. 2, 5 and 6; 
paragraph [0049] and [0050]); 

to open a trial pack as an empty page (i.e. figure 6 is an example of an empty 
trial layout. This shows a view of the page in which the pictures of figure 3 will be 
placed; see fig. 3 and 6; paragraphs [0038] and [0050]); 

using a defined packing areas, to repeatedly continue, if possible, each open 
trial pack (I.e. the selection of the Images placed on the trial layout are automatically 
selected based on the width, height or aspect ratio of the page. With the images 
chosen automatically, the images are continually placed on the page to fit the fomiat 
chosen and normalizing of the Images also takes place. The normalizing ensures that 
the images are distanced from one another in an equivalent manner to create a spatial 
balance between the pictures; see fig. 5; paragraphs [0049]-[0055]) and to close each 
open trial pack that cannot be continued until no trial pack remains open (i.e. once 
normalizing takes place, the images are placed to create a spatial balance. Once this is 
shown to the user for acceptance, the user has a choice to accept the layout or go 
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through the page layout process again until an acceptable page layout is obtained. The 
layout process is completed or closed once the user is displayed the new layout. When 
comparing the trial packs, the trial pack that is being arranged is opened until is it closed 
to be compared to the prior trial pack. This is an example of closing open trial packs 
that cannot have any more images added or rearranged so that the closed trial packs 
can be compared; see fig. 5; paragraphs [0049]-[0055]); and 

wherein the pack generator is operable to continue each open trial pack (i.e. in 
the system, a given number of images are to be laid out on a certain page layout. The 
system ensures that this given number is met. If this given number is not met for the 
layout, the system makes the detemriination and then looks for the image to be placed 
on the page layout to fit the given number of images on the page layout. This is an 
example of the continuing function occurring in the system. If a user is dissatisfied with 
the current layout, the system may redefine new areas to pack images and place those 
image in the new areas for packing while making sure that the designated number of 
images to be placed on the overall layout is still performed; see figs. 5-10; paragraphs 
[0050]-[0064]) by 

identifying a largest pre-determined print size of a digital image remaining in the 
set that will fit in the packing area (I.e. shown in the illustrated prior art image in figure 2 
is a template with the identification of a pre-determined print size for each of the digital 
images to be used on the template. Since this template is used to Identify pre- 
determined print sizes of the pictures to be used, this performs the above feature. Also, 
when the system is using the method of automatically placing pictures in the layout, the 
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system chooses, or identifies, a certain pre-detemnined size on the overall layout to 
place the picture on the layout to be printed. With this pre-detemiined space, the 
images chosen have a pre-detemiined print size and this size is taken into account 
when placing the images on the overall layout. The print size of the images is used to 
assist the system in arranging the images In a more aesthetic manner. The images in 
the system have a pre-determined print size since these images where taken by 
different sources (i.e. digital camera or scanner) and these different sources defined the 
print size for the images and therefore, the pre-detemiined print size feature is 
performed. The system may then normalize the pictures to take away the left over 
white space on the overall layout when these images are placed on the layout. With the 
system able to manually or automatically choose images to be placed on a layout, a last 
image that can fit a remaining space on the layout may be chosen. This image may be 
the largest pre-determined print size that is able to fit that particular space in the image. 
When looking at figure 14, the cross-hatched space may be used to fit a certain image 
and the image chosen may be the largest print size available to fit in that area. When 
the system is using the method of automatically placing pictures in the layout, the 
system chooses, or identifies, a certain pre-determined size on the overall layout to 
place the picture on the layout to be printed. In the system, an image may be identified 
as being much larger or smaller than the rest of the images. The image that is much 
larger than the others is considered as the image with the largest pre-determined print 
size. This image is identified when it is chosen to be placed on the layout and the 
smallest dimension of the image may be normalized in order to create a spatial balance 
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between itself and other images used in the system; see figs. 1-3; paragraphs [0046]- 
[0055] and [0057]-[0067]); 

if it will fit, packing a digital image of the identified largest pre-determined print 
size in a first orientation in a packing area and continuing the open trial pack as a first 
child trial pack (i.e. the amount of images placed on a page is detemiined automatically 
based on the layout and the amount of space that allows the images to achieve a 
spatial balance on the specified layout. If the image with a pre-detemriined print size 
does not assist in creating a spatial balance or there is not enough room to fit an image 
on the page, that image Is not chosen automatically to be placed on the page. When 
the first image with a pre-detemiined print size is chosen, another image with another 
pre-determined print size is chosen to see if the first images together will create a 
spatial balance. If the images together create a spatial balance, other images are 
chosen until the presentation of an image will take the overall page layout out of a 
spatial balance. Then a score is created to represent the amount of space left on the 
page layout. The process described above is an example of continuing the trial layout 
as a child trial pack. The images chosen can be have the smallest or largest pre- 
determined print size, but the process of nonnalization is used to assist in creating the 
spatial balance In the system so that the Image sizes do not become a problem to the 
overall appearance of the layout; see fig. 5, 7 and 11-14; paragraphs [0049]-[0057J); 
and 

if it will fit, packing a digital image of the identified largest pre-detemnined print 
size In a second orientation and continuing the trial pack as a second child trial pack 
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(i.e. during the process that is illustrated in figure 7, the above process that occurs to 
the first or prior trial layout occurs to the new or the second trial layout. The new trial 
layout shows another orientation of the same images, which have the same pre- 
determined print sizes, being used due to the specifications given by the aspect ratio of 
the page format. Also, the above process of the continuing of the trial layout as a first 
trial pack is the same for the second trial layout. The second trial layout is continued as 
a second child trial pack; see fig. 5 and 7; paragraphs [0049H0057] and [0059H0063]); 

the pack selector is operable to compare closed trial packs generated by the 
pack generator, to select a trial pack based upon the comparison (i.e. based on the 
comparison of the trial layouts and their associated scores, the trial layout with the 
lowest cost function or white space score is chosen automatically. Although a pack 
selector is not specifically disclosed, the feature is performed. Also, with the layout 
having the ability to be chosen manually, the feature of a pack selector is believed to be 
performed by the manual function of the invention; see figs. 6-10; paragraphs [0057]- 
[0061]); and. 

until ail digital image from the set are used in one of one or more selected trial 
packs, to direct the pack generator to generate new trial packs for any digital images not 
used in a selected trial pack (i.e. in step 100, the digital images to be chosen are 
recognized to be in a database that stores the pictures. In step 120, images that are 
detemiined to be on the database that are not packed on a page layout, are selected to 
be placed on a page. This process can be performed manually or automatically. The 
images that are chosen in step 120 are images that are not placed on the page layout 
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before that step has occurred. Also in figure 7, other trial layouts are generated and 
images that are not in the presently generated layout are then placed on that layout to 
compare the current layout to a previous layout; see fig. 5 and 7; paragraphs [0049]- 
[0063]). 

Re claim 46: Simon et al discloses the system of claim 43, wherein the packager is 
operable to, for each open trial pack, close that trial pack if no digital Image from the set 
that has yet to be packed in the open trial pack will fit in the packing area (i.e. when 
performing the process of comparing and accepting a page layout, the process of 
continuing to apply images to certain layouts and closing the process of adding images 
because the layouts have the appropriate amount of images on a page is repeated until 
a user decides to accept a displayed layout. The trial layouts are closed when the 
images selected create a spatial balance and any more images added to the layout may 
disrupt the spatial balance in the page format chosen. Therefore, when a page layout 
cannot have any images added to the layout because any page added will not fit in 
order to keep a spatial balance, then the page layout Is closed; see figs. 5 and 7; 
paragraphs [0049]-[0055]). 

Claim Rejections - 35 USC § 103 
1 0. The following is a quotation of 35 U.S.C. 103(a) which fonns the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth In section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
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invention was made to a person having ordinary s!<ili in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

1 1 . Claims 18, 19 and 38, 39 are rejected under 35 U.S.C. 103(a) as being 

unpatentable over Simon et al in view of Shields (US Pub No 2003/0163786). 

Re claim 18: The teachings of Simon et al are disclosed above. 

However, Simon et al fails to teach the method, wherein defining a packing area 
comprises identifying a geometry of a packed space and defining a packing area 
according the geometry of the packed space. 

However, this is well known in the art as evidenced by Shields. Shields disclose 
defining a packing area comprises identifying a geometry of a packed space (i.e. the 
system checks to see if a region of sufficient size exists for the placement of an image. 
Any type of possible shape that Is represented in figure 2 Is recognized to see if the next 
available image can fit in the shape shown; see fig. 2; paragraphs [0012H0015]) and 
defining a packing area according the geometry of the packed space (i.e. the area Is 
then designated as an area to pack images once an appropriate image of the defined 
size is found; see fig. 2; paragraphs [0012]-[0015]). 

Therefore, in view of Shields, it would have been obvious to one of ordinary skill 
at the time the invention was made to defining a packing area comprises identifying a 
geometry of a packed space and defining a packing area according the geometry of the 
packed space in order to check to see if a region is a sufficient size for an image to be 
placed (as stated in Shields paragraph [0014]). 
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Re claim 19: The teachings of Simon et al are disclosed above. 

Simon et al teaches the method, wherein defining a packing area comprises 
identifying a packed space as rectangular (i.e. when looking at figure 2, it is clear that 
areas that will be packed with an image are or designated as rectangular; see fig. 2; 
paragraph [0048]), identifying left over spaces located diagonally, vertically, and 
horizontally relative to the packed space (i.e. when looking at figure 12, element 62 has 
left over spaces that are horizontal (273) and vertical (275) in relation to the packed 
space. Although identifying spaces diagonally is not specifically stated, it is perfonned 
by the device. When performing horizontal sorting, the packed space finds the next 
horizontal space and begins to pack that space with an image. If the next image that is 
chosen performs vertical sorting on the now second image process, it will identify the 
diagonal left over space of the first image that was processed horizontally in the 
beginning of whole horizontal process. Therefore, the feature of identifying the diagonal 
left over space is performed; see fig. 12 and 16; paragraphs [0063]-[00671) and defining 
a second packing area as the remaining horizontal or vertical space (i.e. with horizontal 
and vertical sorting, a packing area or layout area can be defined as a horizontal or 
vertical space when performing the sorting process; see fig. 12 and 16; paragraphs 
[0063]-[0067]). 

However, Simon et al fails to teach combining the diagonal space with either the 
vertical space or the horizontal space creating a combined space having a maximized 
small dimension, and defining a first packing area as the combined space. 
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However, this is well known in the art as evidenced by Shields. Shields discloses 
combining the diagonal space with either the vertical space or the horizontal space 
creating a combined space having a maximized small dimension (i.e. looking at figure 2, 
the space that is left over after placing an image into a certain space is may be 
combined with another space, depending on the image size the system had waiting to 
place on the overall image. Any region of left over space after placing a plurality of 
images can be combined with other pieces of free space left over to create a region to 
fit an appropriate sized image; see fig. 2; paragraphs [0012]-[0015]), and defining a first 
packing area as the combined space (i.e. depending on how the images are oriented, 
space that is left over after the first batch of images are placed is combined to fomi 
spaces that may be used to have smaller images placed on the combined spaces. In 
the invention, the space is used efficiently by not only placing images in decreasing 
height in the overall image, but also to use the spaces left over to place even smaller 
images. Although it does not specifically say defining a first packing area as a 
combined space, the feature is performed since spaces between the placed images are 
combined to form a region in which images can be placed; see fig. 2; paragraphs 
[0012H0015]). 

Therefore, in view of Shields, it would have been obvious to one of ordinary skill 
at the time the invention was made to combining the diagonal space with either the 
vertical space or the horizontal space creating a combined space having a maximized 
small dimension, and defining a first packing area as the combined space in order to 
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check if the next image can be located in one of the openings between the other images 
(as stated in Shields paragraph [0013]). 

Re claim 38: The teachings of Simon et a! are disclosed above. 

However, Simon et al fails to teach the method, wherein the instructions for 
defining a packing area include instructions for identifying a geometry of a packed 
space and defining a packing area according the geometry of the packed space. 

However, this is well known in the art as evidenced by Shields. Shields disclose 
the instructions for defining a packing area include Instructions for identifying a 
geometry of a packed space (i.e. the system checks to see if a region of sufficient size 
exists for the placement of an image. Any type of possible shape that is represented in 
figure 2 Is recognized to see if the next available image can fit in the shape shown. 
Although instructions are not specifically disclosed, it is clear that the system perfonns 
the feature of checking for a certain size of a region to place another image. Also, since 
a computer or some program performs the function above, instructions have to be given 
to such a program to perfonn the above feature; see fig. 2; paragraphs [0012]-(0015]) 
and defining a packing area according the geometry of the packed space (i.e. the area 
is then designated as an area to pack images once an appropriate image of the defined 
size is found; see fig. 2; paragraphs [001 2]-[001 5]). 

Therefore, In view of Shields, it would have been obvious to one of ordinary skill 
at the time the invention was made to have instructions for defining a packing area 
include instructions for identifying a geometry of a packed space and defining a packing 
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area according the geometry of the packed space in order to check to see if a region is 
a sufficient size for an image to be placed (as stated in Shields paragraph [0014]). 

Re claim 39: The teachings of Simon et al are disclosed above. 

Simon et al teaches the method, wherein the instructions for defining a packing 
area include instructions for identifying a packed space as rectangular (i.e. when looking 
at figure 2, it is clear that areas that will be packed with an image are or designated as 
rectangular; see fig. 2; paragraph [0048]), identifying left over spaces located 
diagonally, vertically, and horizontally relative to the packed space (i.e. when looking at 
figure 12, element 62 has left over spaces that are horizontal (273) and vertical (275) in 
relation to the packed space. Although identifying spaces diagonally is not specifically 
stated, it is perfomned by the device. When perfomiing horizontal sorting, the packed 
space finds the next horizontal space and begins to pack that space with an image. If 
the next image that is chosen performs vertical sorting on the now second image 
process, it will identify the diagonal left over space of the first image that was processed 
horizontally in the beginning of whole horizontal process. Therefore, the feature of 
identifying the diagonal left over space is performed; see fig. 12 and 16; paragraphs 
[0063]-[0067]) and defining a second packing area as the remaining horizontal or 
vertical space (i.e. with horizontal and vertical sorting, a packing area or liayout area can 
be defined as a horizontal or vertical space when perfomiing the sorting process; see 
fig. 12 and 16; paragraphs [0063]-[0067]). 
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However, Simon et al fails to teach combining the diagonal space with either the 
vertical space or the horizontal space creating a combined space having a maximized 
small dimension, and defining a first packing area as the combined space. 

However, this is well known in the art as evidenced by Shields. Shields discloses 
combining the diagonal space with either the vertical space or the horizontal space 
creating a combined space having a maximized small dimension (i.e. looking at figure 2, 
the space that is left over after placing an image into a certain space is may be 
combined with another space, depending on the image size the system had waiting to 
place on the overall Image. Any region of left over space after placing a plurality of 
images can be combined with other pieces of free space left over to create a region to 
fit an appropriate sized image; see fig. 2; paragraphs [0012]-[0015]), and defining a first 
packing area as the combined space (i.e. depending on how the images are oriented, 
space that is left over after the first batch of images are placed is combined to form 
spaces that may be used to have smaller images placed on the combined spaces. In 
the invention, the space is used efficiently by not only placing images in decreasing 
height in the overall Image, but also to use the spaces left over to place even smaller 
images. Although it does not specifically say defining a first packing area as a 
combined space, the feature is performed since spaces between the placed images are 
combined to form a region in which images can be placed; see fig. 2; paragraphs 
[0012H0015]). 

Therefore, in view of Shields, it would have been obvious to one of ordinary skill 
at the time the invention was made to combine the diagonal space with either the 
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vertical space or the horizontal space creating a combined space having a maximized 
small dimension, and defining a first packing area as the combined space in order to 
check if the next image can be located in one of the openings between the other images 
(as stated in Shields paragraph [0013]). 

12. Claims 20 and 40 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Simon et al in view of Doi et al (US Pat No 6208360). 

Re claim 20: The teachings of Simon et al are disclosed above. 

Simon et al teaches the method, wherein identifying a packing area comprises 
identifying a packed space (i.e. in the layout of the images in figure 5, the area where 
the image will be placed in identified either automatically or manually; see fig. 5; 
paragraphs [0049]-[0055]), maximizing a jagged space (i.e. shown in figures 8-10 are 
examples of the system maximizing the use of spaces that may appeared to be jagged 
or not completely rectangular. Through normalizing and scaling, the jagged spaces in 
figure 8 are maximized by the previous stated methods and is illustrated in figures 9-12; 
see figs. 8-12; paragraphs [0049H0055]), identifying remaining spaces that are located 
vertically and horizontally relative to the packed space (i.e. in fig. 16, the blank or white 
spaces located horizontally and vertically of the packed spaces are identified; see fig. 
12 and 16; paragraphs [0063]-[0065]), defining a first packing area as the maximized 
jagged space (i.e. in figure 14, a crosshatched region is present. This region with the 
surrounding blank region around the crosshatched region is considered as a jagged 
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space. The user is utilizing this space in this arrangement, but can multiple different 
arrangements. However, this can be considered as the first packing area as the 
maximized jagged space since it is being used to pacl^ some type of data and the 
crosshatched region is a large region being used in figure 14; see fig. 14; paragraph 
[0067]), defining a second packing area as the left over vertical space (i.e. in using the 
method of figure 16, an area is defined as the vertical white space or the space above 
or below the packed space; see fig. 12 and 16; paragraphs [0063]-[0065]), and defining 
a third packing are as the left over horizontal space (i.e. in using the method of figure 
16, an area is defined as the horizontal white space or the space to the left or right of 
the packed space; see fig. 12 and 16; paragraphs [0063]-[0065]). 

However, Simon et al fails to teach identifying a packed space as irregular. 

However, this is well known in the art as evidenced by Doi '360. Doi '360 
discloses identifying a packed space as irregular (i.e. when viewing a 3D image, the 
irregularity of the shape is recognized by a distance measuring device; see col. 3. lines 
52-58). 

Therefore, in view of Doi '360, it would have been obvious to one of ordinary skill 
at the time the invention was made to identifying a packed space as irregular 
incorporated in the device of Simon et al in order to recognize the irregularity of an 
image (as stated in Doi '360 col. 3, lines 52-58). 

Re claim 40: The teachings of Simon et al are disclosed above. 
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Simon et al teaches the method, wherein the instructions for defining a pacl^ing 
area include instructions for identifying a pacl^ed space (i.e. in the layout of the images 
in figure 5, the area where the image will be placed in identified either automatically or 
manually; see fig. 5; paragraphs [0049]-l0055]), maximizing a jagged space (i.e. shown 
in figures 8-10 are examples of the system maximizing the use of spaces that may 
appeared to be jagged or not completely rectangular. Through normalizing and scaling, 
the jagged spaces in figure 8 are maximized by the previous stated methods and is 
illustrated in figures 9-12; see figs. 8-12; paragraphs [0049]-[0055]), identifying 
remaining spaces that are located vertically and horizontally relative to the packed 
space (i.e. in fig. 16, the blank or white spaces located horizontally and vertically of the 
packed spaces are identified; see fig. 12 and 16; paragraphs [0063]-[0065]), defining a 
first packing area as the maximized jagged space (i.e. in figure 14, a crosshatched 
region is present. This region with the surrounding blank region around the 
crosshatched region is considered as a jagged space. The user is utilizing this space in 
this arrangement, but can multiple different arrangements. However, this can be 
considered as the first packing area as the maximized jagged space since it is being 
used to pack some type of data and the crosshatched region is a large region being 
used in figure 14; see fig. 14; paragraph [0067]), defining a second packing area as the 
left over vertical space (i.e. in using the method of figure 16, an area is defined as the 
vertical white space or the space above or below the packed space; see fig. 12 and 16; 
paragraphs [0063]-[00651), and defining a third packing are as the left over horizontal 
space (i.e. in using the method of figure 16, an area is defined as the horizontal white 
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space or the space to the left or right of the packed space; see fig. 12 and 16; 
paragraphs [0063]-[0065]). 

However. Simon et al fails to teach identifying a packed space as irregular. 

However, this is well known in the art as evidenced by Doi '360. Doi '360 
discloses identifying a packed space as irregular (i.e. when viewing a 3D image, the 
irregularity of the shape is recognized by a distance measuring device; see col. 3, lines 
52-58). 

Therefore, in view of Doi '360, it would have been obvious to one of ordinary skill 
at the time the invention was made to identifying a packed space as irregular 
incorporated in the device of Simon et al in order to recognize the irregularity of an 
image (as stated in Doi '360 col. 3, lines 52-58). 

Conclusion 

1 3. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
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extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

14. The prior art made of record and not relied upon Is considered pertinent to 
applicant's disclosure. 

15. Shields (US Pub No 2003/0163786), which was used as a 103 reference on 
claims 18, 19, 38 and 39, is also readable on the claims that disclose selecting digital 
images, opening, continuing and closing of a trial pack. In addition, the above reference 
reads the newly added limitation of identifying the largest pre-determined print size 
since it firids an image that can fit a designated area and the system picks the largest 
image to fit the area and places that in the designated area. 

16. Tonomura et al (US Pat 6571 054) reads on the claims that state the feature of 
designating a packing area, determining an image that has yet to be packed and filling 
the packing area with the image or images in multiple orientations and multiple layouts 
or trial packs. It also reads on the features of generating multiple trial packs, comparing 
the trial packs and selecting the trial packs based on the comparison. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Chad Dickerson whose telephone number is (571)-270- 
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1351. The examiner can nomnally be reached on IVIon. thru Thur. 9:00-6:30 Fri. 9:00- 
5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Aung Moe can be reached on (571)- 272-7314. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Infomnation Retrieval (PAIR) system. Status infonnation for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
CD/C^ 

Chad Dickerson a i ^ 

October 25, 2007 /[ 

/AUNG S. MOE 
tSOBY PATENT EXAMINER 




